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* NOTICES * 



Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 



1. This document has been translated by computer.So the translation may not reflect the original precisely. 

2. *** * shows the word which can not be translated, 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The conversation auxiliary device for deaf-mutes characterized by providing the following. The main 
part which can be held single hand. The manual-input means prepared in the superficies of the main part. A 
speech synthesis means to change into a sound signal the message inputted by the input means, [t is a 
means to tell the other party about this when the above-mentioned speech recognition is not completed with 
the display for us which turns the above-mentioned message to us by making the loudspeaker which turns 
and **** the changed sound signal to the other party, the microphone which carries out [ voice / from the 
above-mentioned other party] sound reception, the speech recognition means which carri&s out speech 
recognition of the output signal of the microphone, and its signal by which speech recognition was carried out 
into e character, and is displayed, respectively. 

[Claim 2] The conversation auxiliary device for a translation characterized by providing the following. The 
main part which can be held single hand. The input means prepared in the main part A translation means to 
translate into other languages the message inputted into the input means. A speech synthesis means to 
change the translated message into a sound signal, and a **** means to **** the voice, The microphone 
which carries out [ voice / from the other party ] sound reception, and the speech recognition means which 
carries out speech recognition of the output signal of the microphone, A translation means to translate the 
recognized signal into the language of the above-mentioned message, a speech synthesis means to change 
the translated language into a sound signal, a **** means to **** the sound signal, and a means to tell the 
other party about what the above-mentioned speech recognition was not able to oarry out. 
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* NOTICES * 

Japan Patent Office 1$ not responsible for any 
damages caused by the use of this: trans I at ion. 

I.This document has been translated by computer. So the translation may not reflect tfye original precisely. 
2 **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 

DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the conversation auxiliary device for a translation which 
assists a with the both conversation, when the conversation auxiliary device which assists that an acoustic 
sense or an aphasic, and a healthy person talk mutually, and those who differ in language mutually talk 
[0002] 

[Description of the Prior Art] What is shown in JP,1-88554,U as a conversation auxiliary device for deaf- 
mutes in the former is proposed. If a message is inputted when those who have a handicap in a language 
system operate the key of a keyboard, this synthesizes voice from the inputted message, and **** it to the 
other party as a sound signal. However, one-way traffic-like [ voice from the other party cannot be told to a 
deaf-mute, and ]. 

[0003] Moreover, although there is an electronic dictionary as an auxiliary device of a translation in the 
former, it cannot use for the conversation of fellow those who can lengthen the word which is not known, can 
only know the dictionary when using for conversation, and does not know a partner's language at all. 
[0004] 

[Means for Solving the Problem] According to invention of a claim 1, this conversation auxiliary device is 
made into the size which it can have single hand, manual-input meanses, such as a key, are prepared in the 
front face of the main part, the message inputted by the manual-input means is changed into a sound signal 
by the speech synthesis means, and the changed sound signal is ****(ed) by the other party by the 
loudspeaker. Moreover, as a character, sound reception of the voice from the other party is carried out with a 
microphone, speech recognition of the output signal of the microphone is carried out by the speech 
recognition means, and the above-mentioned message is displayed by the display for us. and the recognized 
signal is made as [ tell / the other party / that ], when recognition by the speech recognition means is not 
completed on the other hand 

[0005] According to invention of a claim 2. the main part is constituted by the grade which can hold this 
single hand similarly, a message oan be inputted into the main part by the input means, the inputted message 
is translated into the language of'the message, and a different language. i.e.. the other party's language, by the 
translation means, the translated signal is changed into a sound signal by the speech synthesis means, and 
the sound signal is ****(ed) by the loudspeaker. Sound reception of the voice from the other party is carried 
out with a microphone, speech recognition of the output of the microphone is carried out by the speech 
recognition means, the recognized signal is translated into the language of the above-mentioned message by 
the translation means, a speech synthesis means synthesizes voice from the translated sound signal, and the 
compounded sound signal is ****(ed) by the loudspeaker. Moreover, when speech recognition is not 
completed by the speech recognition means, it is made as [ tell / the other party / about this ] 
[0006] 

[Example] The example of appearance applied to drawing 1 at all of the conversation auxiliary device of a 
claim 1 and a claim 2 is shown. This example is consisted of by boxHike [ as a whole / thinner / long and 
slender ], a main part 1 1 is the size which the usual man can hold single hand, it is referred to as narrow 
section 11a with narrow width ef face so that rt may be easy to grasp the portion of the near side single hand, 
and the front section is set to broad section 1 1b by which width of face was somewhat made large. In this 
example, the key is prepared in the front face of this main part 11 as an input means. On the front face 12, 
the letter keys 13, such as a key; of kana and an alphabetic-character key, are mainly arranged and formed on 
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narrow section 11a. Moreover, the function key 14 is formed in the side of narrow section 11a. Phonation 
instruction key Ha m a function key is prepared .near the thumb of the hand 15 which grasped this narrow 
section 1 1 a, and other function keys are prcparejd near the positions, such as jamming people ****** and the 
middle finger, other side side. Moreover, in this example, the mode selection key 16 for it is formed by the 
case where it enables it to use it, changing to the object for deaf-mutes, and a translation. 
[0007] The display 17 for us and the display 18 for the other parties are formed in the upper surface of broad 
section 11b of a main part 11. the slant face of the near side of the triangle pole extended in the longitudinal 
direction is made into the screen of the display 17 for us. the slant face by the side of the front is made into 
the screen of the display 18 for the other parties, and a display is legible and is made, respectively. The 
microphone 21 for the loudspeaker 19 for ****(ing) voice to the other party being formed in the front edge of 
this main part 1 1, and oarrying out [ voice / from the other party ] sound reception is attached 
[0008] With reference to drawing 2 . the functional composition of the conversation auxiliary device for deaf- 
mutes is explained When the keyboard 23 of a letter key 13 and a function control key 14 is operated and a 
message is inputted one by one for every character of that, it is changed into the code which corresponded 
with each of that operated key by the text input-process circuit 24 t the array of the code which shows each 
character of the message is supplied to the speech synthesis circuit 25 from the text input-process circuit 
24. it synthesizes voice in the speech synthesis circuit 25. and the speech synthesis signal is ****(ed) by the 
loudspeaker 19. Moreover, it is displayed on the display 17 for us. the text code which shows the message 
from the text input-process circuit 24 is supplied also to the text display circuit 26, the message looks at the 
display of a display 17, and checks that it has been correct in the inputted message, and when the late- 
coming voice key 14b is operated the synthesized-speech signal compounded in the speech synthesis circuit 
25 is ****(ed) from a loudspeaker 19. 

[0009] If the other party does the reply which receives that the voice ****(ed) from this loudspeaker 19 is 
heard, rt is caught with a microphone 21. the output of the microphone 21 will be processed in the voice input 
processing circuit 27, speech recognition will be further carried out in the speech recognition circuit 28, and 
the signal by which speech recognition was carried out will be displayed on the we display 17 and the display 
18 for partners through the text display 26. respectively as a character string. 

[0010] If the portion which cannot be recognized in the speech recognition circuit 28 at this time arises, that 
will be notrfied to the text input-process circuit 24. The message which tells the thing memorized beforehand, 
for example, the text referred to as "already ******-wish-doing~, is read in the routine-message registration 
memory 29 of the interior. It synthesizes voice from it in the speech synthesis circuit 25, and the signal from 
which it synthesized voice is ****(ed) from a loudspeaker 19, and the same thing is spoken to the other party 
and it is made to be given once again, Moreover, in the display in the display 18 for partners, it can also tell 
that there is a portion which was not able to carry out speech recognition of the other party by displaying the 
portion which was not able to carry out speech recognition for example, with an asterisk sign. In this case, 
since this portion that has not been recognized is known, next it utters more clearly and a recognition jerror 
can be prevented from being generated so that that may be easy to be recognized. 
[0011] Thus, if the deaf-mute who cannot utter voice inputs a message manually according to this 
conversation auxiliary device, a deaf-mute and a healthy person are able for thus to be ****(ed) by the other 
party as voice, and for the message with the voice from the other party to be displayed on a display by 
speech recognition as a text on the other hand and to talk. In this case, not only the previous example of 
"already ******-wish-doing" but a message which is often used memorizes the routine-message registration 
memory 29 beforehand, and this can be read by easy operation. In addition, only not only when being based on 
both with the case where it is based on the case where it is based on voice, and a display as stated 
previously, in order to tell the other party about the ability to have not carried out speech recognition, but 
one of these is. Moreover, not only when based on a letter key 13 as an input means, but a pen input may be 
used 

[0012] Next, with reference to drawing 3 . the functional composition of the conversation auxiliary device for 
a translation is explained. The same sign is attached to drawing 2 and the corresponding portion in drawing 3 . 
A keyboard 23 is operated and the message which it is going to translate in this example is inputted- For 
example, if a message is inputted in Japanese, the input from the keyboard will be changed into the code of a 
character by the text input-process circuit 24, and the message of the code train of the character wilf. be 
translated into the message of the language witn which the message of the Japanese differs from this by the 
translating circuit 31. for example, for example. English, the — it translated, i.e., in this example, convolution 
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transformation of the English message is carried out to a sound signal in the speech synthesis circuit 25. and 
,"t is ****j[ed) by the other party through a loudspeaker 19 Only when it displays whether the message 
inputted also in this case is right on the display 17 for us through the text display circuit 26 and the right 
message is inputted in it the key of translational control or the instruction key to a speech synthesis circuit 
can be pushed, and the right sound signal can be ****(ed) through a loudspeaker 19. 
[0013] Oh the other hand, although the message from this loudspeaker 19 is heard and the other party 
performs the answer in English, sound reception of it is carried out with a microphone 21, it is processed by 
the voice input processing circuit 17. and speech recognition is further carried out in the speech recognition 
circuit 28. This signal by which speech recognition was carried out is translated into Japanese by the 
translating circuit 32 from English, the character string of the translated Japanese is inputted into the speech 
synthesis circuit 33, the signal from which it synthesized voice is ****(ed) from a loudspeaker 34. and this 
loudspeaker 34 is turned so that it may **** for us. 

[0014] Under the present circumstances, when it has not recognized like the case of the point in the speech 
recognition circuit 28, in order to notify the other party of that, what is called text "l already **=r***-nwish- 
do" of a fixed form from the memory 29 of the text-processing circuit 24 is read automatically, and it is made 
as [ **** / by the other party / it is translated by the translating circuit 32, is compounded further in the 
speech synthesis circuit 25, end / it / from a loudspeaker 19 ]. Furthermore, the thing [ that speech 
recognition was not able to be carried out ] is notified to the speech recognition circuit 28 if needed. It tells 
that the speech recognition result was displayed on the display 18 for partners, and speech recognition was 
not able to be carried out to the other party. 

[0015] Thus, those who can speak only Japanese, for example, and those who can speak only English can talk. 
Voice input may be carried out instead of the input by the keyboard 23, the inputted voice may be recognized, 
and the recognition result may be supplied to a translating circuit 31. Moreover, displays 17 and 18 may omit 
When the voice of the other party or us has not simply been recognized, it is necessary to establish a means 
to tell the other party and us about it by a certain means. Moreover, it is good also as a pen input instead of a 
keyboard 23. It prepares instead of [ one ] forming two loudspeakers 19 and 34. and the other party and we 
may enable it for the sound from the loudspeaker to catch, 
[0016] 

[Effect of the Invention] As stated above, according to invention of a claim 1, a deaf-mute and a healthy 
person can tell not one-way traffic but the volition here for the usual conversation with voice, and a healthy 
person's voice can be told to a deaf-mute in written form, and a bidirectional conversation is possible. 
Smooth conversation can be held and, unlike the case where a dictionary is used, it is not necessary 
according to invention of a claim 2. to know the other party's language at all that we and the other party 
should just hold the usual conversation in each language also in this oase. 

[0017] Furthermore, it consists of [ small ] this invention so that a main part 11 can be grasped single hand, 
and he can have easily, he can walk, it can be operated single hand, and handling is convenient In this case, 
when translating a conversation grade every day. a translating circuit can also be made as a small 1C and can 
also use a translation enough. Moreover, by preparing a function key in the side of a main part, and preparing 
a letter key in a front face, it has with the left hand, a surface key is operate d' with the right hand, a function 
key can be operated with a left finger, and operability is good. 
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* NOTICES * 

Japan Partent Office is not responsible for any 
damages caused by the use of this {translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

fD rawing 11 The perspective diagram showing the example of appearance of the conversation auxiliary device 
by this invention. 

[Drawing 2] The block diagram showing the example of functional composition of invention of a claim 1. 
[Dra wing 31 The block diagram showing the example of functional composition of invention of a claim 2. 
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